inwilling to compete under such conditions. The lack of liversity among evaluation contractors reduces the >ossibility of new ideas entering the evaluation system md thereby improving it. Perspectives of beneficiary >opulations, in particular/ are underrepresented on both ;he sponsor and the performer sides.
Flexibility in evaluation, which could contribute to [uality, has also been reduced because of emphasis in tfc >ast on large studies. The restrictions on creativity .mposed by this approach are aggravated when a single .ndividual or small group within the Department develops :he main procurement instrument, as is usually the case. in additional constraint on flexibility and creativity i :he current monitoring process, which makes it difficult :o adjust the course of a study because of changed field :onditions or because a different research direction is rarranted.
A third explanation for problems of quality is that :he intellectual marketplace for appraisal and scrutiny >f evaluations has yet to be fully formed. Generally, ihere is no review by outside experts during the >rocurement phase when the main elements of a study are >eing designed; the lack of diversity among competitors lor evaluation work further inhibits opportunities for :he marketplace to operate; and, upon completion of a Jtudy, external review of final reports happens only iporadically.  Institutional mechanisms for encouraging imple discussion by experts and parties at interest of dans for and findings of major studies are spotty at th lederal level; they are largely absent at the state and .ocal levels.
Using the Results of Evaluation
frequently voiced criticism of evaluation is that valuation findings are seldom used.  Implicit in this